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pipeline accelerator generates pipeline data from the host data. Alternatively, trie pipeline accelerator 
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making and mamematscatly ^tensive operations,; By shifting the mathematical^ intensive operations 
to the accelerator, the peer-vector machine often can, for a given clock frequency, process data at a 
speed that surpasses iUe speed at which a processor-oniy machine can process the data. 
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PIPELINE ACCELERATOR: HAVING MULTIPLE PIPELINE UNITS AND RELATED 

COMPUTING MACHINE AND METHOD 

Claim of priority 

PI This application claims priority to U.S. Provisional Application Serial 

No. 60/422,603, filed on October 31 , 2002, which is incorporated by reference, 

Cross reference to related applications 

[2J This application is related to U.S. Patent App. Sena! Ncs. 10/884,1 02 

entitled IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, 10.684,053 entitled COMPUTING MACHINE HAVING IMPROVED 
COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, 
10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD, and 10/884,05? entitled 
PROGRAMMABLE CIRCUIT AND RELATED COMPUTING MACHINE AND 
METHOD, all filed on Octobers, 2003, and having a common owner, and which are 
incorporated by reference. 

Background 

[33 A common computing architecture for processing relatively large 

amounts of data in a relatively short period of time includes multiple interconnected 
processors that share the processing burden. By sharing the processing burden, 
these multiple processors can often process the data more quickly than a single 
processor can for a given clock frequency. For example, each of the processors can 
process a respective portion of the data or execute a respective portion of a 
processing algorithm, 

|4] FIG. 1 1s a schematic block diagram of a conventional computing 

machine 10 having a multi-processor architecture. The machine 1 0 includes a 
master processor 12 and coprocessors 14i - 14„, which communicate with each 
other and f ie master processor via a bus 16, an input port 1 B for receiving raw data 
from a remote device (not shown in FIG, 1), and an output port 20 for providing 
processed data to the remote source. The machine 10 also includes a memory 22 
for the master processor 12, respective memories 24? ~ 24 n for the coprocessors 14 1 
- 14 n> and a memory 26 that the master processor and coprocessors share via the 

1 . 
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bus 16. The memory 22 serves as both a program and a working memory for the 
master processor 12, and each memory 24? ~ 24 n serves as both a program and a 
working memory for a respective coprocessor 14%- 14„, The shared memory 2® 
allows the master processor 1 2 and the coprocessors 14 io transfer data among 
themselves, and from/to the remote device via the ports 18 and 20, respectively. 
The master processor it and the coprocessors 14 also receive a common clock 
signal thai controls the speed at which the machine 10 processes the raw data. 

[5] In general, the computing machine 10 effectively divides the 

processing of raw data among the master processor 12 and the coprocessors 14, 
The remote source (not shown in FIG. 1} such as a sonar array loads the raw data 
via the port 18 Into a section of the shared memory 2$, which acts as a 
fifst-ln-flrst-out (FIFO) buffer (not shown) for the raw data. The master processor 12 
retrieves the raw data from the memory 20 via the bus 10, and then the master 
processor and the coprocessors 14 process the raw data, transferring data among 
themselves as necessary via the bus 18. The master processor 12 loads the 
processed data Into another FIFO buffer (not shown) defined in the shared memory 
26, and the remote source retrieves the processed data from this FIFO via the port 
20, 

m In an example of operation, the computing machine 10 processes the 

raw data by sequentially performing n + 1 respective operations on the raw data, 
where these operations together compose a processing algorithm such as a Fast 
Fourier Transform (FFT). More specifically, the machine 10 forms a data-processing 
pipeline from the master processor 12 and the coprocessors 14. For a given 
frequency of the clock signal, such a pipeline often allows the machine 10 to process 
the raw data faster than a machine having only a single processor. 

Ul Mar retrieving the raw data from the raw-data FIFO (not shown) In the 

memory 20, the master processor 12 performs a first operation, such as a 
trigonometric function, on the raw data. This operation yields a first result, which the 
processor 12 stores in a first-result FIFO {not shown) defined within the memory 26, 
Typically, the processor 12 executes a program stored In the memory 22, and 
performs the above-described actions under the control of the program. The 
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processor 12 may also use the memory 22 as working memory to temporarily store 
data that the processor generates at Intermediate intervals of the first operation, 

|SJ Next, after retrieving the first result from toe first-result FIFO {not 

shown) In the memory 26, the coprocessor 14^ performs a second operation, such 
5 as a logarithmic function, on the first result. This second operation yields a second 
result, which the coprocessor 14i stores in a second-result FIFO (not shown) defined 
within the memory 2$. Typically, the coprocessor 14 1 executes a program stored in 
the memory 24% and performs the above-described actions under the control of the 
program. The coprocessor 14, may aiso use the memory 24 t as working memory to 
1 0 temporarily store data that the coprocessor generates at intermediate intervals of the 
second operation. 

IWI Then, the coprocessors 24% ~~ 24„ sequentially perform third - n m 

operations on the second - (n~1) m results in a manner similar to that discussed 
above for the coprocessor 24*. 

1 5 [101 The n m operation, which is performed by the coprocessor 24 m yields 

the final result, Le„ the processed data. The coprocessor 24» loads the processed 
data into a processed-data FIFO {not shown) defined within the memory 26, and the 
remote device (not shown in FIG. 1) retrieves the processed data from this FIFO. 

[11 J Because the master processor 12 and coprocessors 14 are 

20 simultaneously performing different operations of the processing algorithm, the 

computing machine 1 8 is often able to process the raw data faster than a computing 
machine having a single processor that sequentially performs the different 
operations, Specifically, the single processor cannot retrieve a new set of the raw- 
data until it performs all n + 1 operations on the previous set of raw data. But using 
25 the pipeline technique discussed above, the master processor 12 can retrieve a new 
set of raw data after performing only the first operation. Consequently, for a given 
clock frequency, this pipeline technique can increase the speed at which the 
machine 10 processes the raw data by a factor of approximately n * 1 as compared 
to a single-processor machine (not shown in FIG. 1). 

30 [12J Alternatively, the computing machine 10 may process the raw data in 

parallel by simultaneously performing n + 1 instances of a processing algorithm, 
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such as an FFT, on the raw data. That is, if the algorithm includes n * 1 sequential 
operations as described above In the previous exam ple, then each of the master 
processor 12 and the coprocessors 14 sequentially perform ail n * 1 operations on 
respective sets of the raw data. Consequently, for a given clock frequency, this 
5 parallel-processing technique, like the above-described pipeline technique, can 
increase the speed at which the machine 10 processes the raw data by a factor of 
approximately n * 1 as compared to a single-processor machine (not shown in FIG. 
1). 

|13| Unfortunately, although the computing machine 10 can process data 

1 0 more quickly than a single-processor computing machine (not shown in FIG. 1 ), the 
data-processing speed of the machine 10 is often significantly less than the 
frequency of the processor clock. Specifically, the data-processing speed of the 
computing machine 10 is limited by the time that the master processor 12 and 
coprocessors 14 require to process data. For brevity, an example of this speed 

1 5 limitation is discussed in conjunction with the master processor 12, although it is 
understood that this discussion also applies to the coprocessors 14. As discussed 
above, the master processor 12 executes a program that controls the processor to 
manipulate data in a desired manner. This program includes a sequence of 
instructions that the processor 12 executes. Unfortunately, the processor 12 

20 typically requires multiple clock cycles to execute a single Instruction, and often must 
execute multiple instructions to process a single value of data. For example, 
suppose that the processor 12 is to multiply a first data value A (not shown) by a 
second data value B (not shown). During a first clock cycle, the processor 12 
retrieves a multiply instruction from the memory 22. During second and third clock 

25 cycles, the processor 12 respectively retrieves A and B from the memory 2$, During 
a fourth clock cycle, the processor 12 multiplies A and S, and, during a fifth clock 
cycle, stores the resulting product In the memory 22 or 26 or provides the resulting 
product to the remote device (not shown). This is a best-case scenario, because In 
many cases the processor 12 requires additional clock cycles for overhead tasks 

30 such as initializing and closing counters. Therefore, at best the processor 12 
requires five clock cycles, or an average of 2.5 clock cycles per data value, to 
process A and B.. 
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|14| Consequently, the speed at which the computing machine 10 

processes data is often significantly lower than the frequency of the clock that drives 
the master processor 12 and the coprocessors 14. For example, if the processor 12 
is clocked at 1 ,0 Gigahertz (GHz) but requires an average of 2,5 clock cycles per 
5 data value, then the effective data-processing speed equals (1 .0 GHz)/2.5 * 0.4 
GHz. This effective data-processing speed is often characterized in units of 
operations per second. Therefore, in this example, for a clock speed of 1 .0 GHz, the 
processor 1 2 would he rated with a data-processing speed of 0.4 
Gigaoperaitona/second (Oops). 

1 0 |1 5| FIG. 2! is a block diagram of a hardwired data pipeline $0 that can 

typically process data fester than a processor can for a given clock frequency, and 
often at substantially the same rate at which the pipeline Is clocked. The pipeline 30 
includes operator circuits 32? - 32,*whfch each perform a respective operation on 
respective data without executing program instructions. That is, the desired 

1 5 operation is "homed in" to a circuit 32 such that it implements the operation 

automatically, without the need of program instructions. By eliminating the overhead 
associated with executing program Instructions, the pipeline 30 can typically perform 
more operations per second than a processor can for a given clock frequency, 

[1 6| For example, the pipeline W can often solve the following equation 

20 fester than a processor can for a given dock frequency: 

where Xk represents a sequence of raw data values. In this example, the operator 
circuit 32i Is a multiplier that calculates 5x k , the circuit 32 2 is an adder that calculates 
5x** 3, and the circuit 3Z, (n » 3) is a multiplier that calculates (5x* «■ 3)2***, 

25 [1 7} During a first clock cycle k*1 , the circuit 32* receives data value x-i and 

multiplies it by 5 to generate 5xi. 

p®| During a second clock cycie k ~ 2, the circuit 32 2 receives 5xi from the 

circuit 32i and adds 3 to generate Sx s * 3. Also, during the second clock cycle, the 
circuit 32? generates 5x 2 . 

30 m During a third clock cycle k ~ 3, the circuit 32 3 receives 5x t * 3 from the 

circuit 322 and multiplies by 2 s1 (effectively left shifts 5xi + 3 by Xt) to generate the 
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first result (5xi * 3)2 , Also during the third dock cycle, the circuit 32,< generates 5x 5 
arid the circuit 32 2 generates 5xa * 3. 

pOj The pipeline $0 continues processing subsequent raw data values Xj< in 

this manner until aii the raw data values are processed, 

5 pi J Consequently, a delay of two clock cycles after receiving a raw data 

value Xi — this delay is often called the latency of the pipeline 30 —the pipeline 
generates the result (5x ; + 3)2*\ and thereafter generates one result ™ e.g., {5x 2 + 
3)2* 2 , (5x 3 * 3)2*, , . „ 5x« + 3}2 ;<r ' ™ each clock cycle, 

|22J Disregarding the latency, the pipeline 30 thus has a data-processing 

1 0 speed equal to the clock speed, in comparison, assuming that the master processor 
12 and coprocessors 14 (FIG. 1) have data-processing speeds that are 0.4 times the 
clock speed as in the above example, the pipeline 30 can process date 2.5 times 
fester than the computing machine 10 (FIG. 1} for a given clock speed. 

P3J Still referring to FIG. 2, a designer may choose to implement the 

1 5 pipeline 30 in a programmable logic IC (PUG), such as a field-programmable gate 
array (FPGA), because a FLIC allows more design and modification flexibility than 
does an application specific iC (ASiC), To configure the hardwired connections 
within a PUC, the designer merely sets interconnection-configuration registers 
disposed within the PLIC to predetermined binary states, The combination of ail 
20 these binary states is often called 'firmware." Typically, the designer loads this 

firmware Into a nonvolatile memory (not shown in FIG. 2) that is coupled to the PUC, 
When one "turns on* the PUC, It downloads the firmware from the memory into the 
interconnection-configuration registers. Therefore, to modify the functioning of the 
PLIC, the designer merely modifies the firmware and allows the PUC to download 
25 the modified firmware into the interconnectlon-configu ration registers. This ability to 
modify the PLIC by mereiy modifying the firmware is particularly useful during the 
prototyping stage and for upgrading the pipeline 30 In the field". 

fMj Unfortunately , the hardwired pipeline $0 may not be the best choice to 

execute algorithms that entail significant decision making, particularly nested 
30 decision making, A processor can typically execute a nested-dectsion-making 
Instruction (e.g., a nested conditional instruction such as if A s then do 8, else if C, 
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do D, , . «, else do n") approximately as fast as it can execute an operational 
instruction (e.g., "A * 8 s ) of comparable length. But although the pipeline SO may foe 
able to make a relatively simple decision (e.g., "A > B?") efficiently, it typically cannot 
execute a nested decision (94., if A, then do B, else If C, do D, . , else do rf 5 as 
5 efficiently as a processor can. One reason for this inefficiency is that the pipeline W 
may have little en-board memory, and thus may need to access external 
working/program memory (not shown). And although one may be able to design the 
pipeline 30 to execute such a nested decision, the size and complexity of the 
required circuitry often makes such a design impractical, particularly where an 
1 0 algorithm includes multiple different nested decisions. 

£253 Consequently, processors are typically used in applications that require 

significant decision making, and hardwired pipelines are typically limited to "number 
crunching' 1 applications that entail little or no decision making. 

[26] Furthermore, as discussed below, it is typically much easier for one to 

15 design/modify a processor-based computing machine, such as the computing 
machine 10 of FIG. 1 , than it Is to design/modify a hardwired pipeline such as the 
pipeline 30 of FIG. 2, particularly where the pipeline 30 includes multiple PUCs. 

|27| Computing components, such as processors and their peripherals 

(e.g., memory), typically include industry-standard communication interfaces that 
20 facilitate the Interconnection of the components to form a processor-based 
computing machine. 

[28J Typically, a standard communication interface includes two layers: a 

physical layer and a services layer. 

|29| The physical layer includes the circuitry and the corresponding circuit 

25 Interconnections that form the interface and the operating parameters of this 
circuitry. For example, the physical layer includes the pins that connect the 
component to a bus, the buffers that latch data received from the pins, and the 
drivers that drive signals onto the pins. The operating parameters include the 
acceptable voltage range of the data signals that the pins receive, the signal timing 
30 for writing and reading data, and the supported modes of operation (e.g., burst 
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mode, page mode). Conventional physical layers include transistor-transistor logic 
(TIL) and RAMBUS, 

|301 The services layer includes the protocol by which a computing 

component transfers data. The protocol defines the format of" the data and the 
5 manner in which the component sends and receives the formatted data. 

Conventional communication protocols Include file-transfer protocol {FTP} and 
transmission control protocol/internet protocol (TCP/IP), 

£31 J Consequently, because manufacturers and others typically design 

computing components having industry-standard communication Interfaces, one can 
1 0 typically design the interface of such a component and interconnect it to other 

computing components with relatively little effort. This allows one to devote most of 
his time to designing the other portions of the computing machine, and to easily 
modify the machine by adding or removing components. 

[32| Designing a computing component that supports an Industry-standard 

1 5 communication interface allows one to save design time by using an existing 

physical-layer design from: a design library. This also insures that he/she can easily 
interface the component to off-the-shelf computing components. 

|33J And designing a computing machine using computing components that 

support a common industry-standard communication interface allows the designer to 

20 Interconnect the components with little time and effort. Because the components 
support a common interface, the designer can interconnect them via a system bus 
with little design effort. And because the supported interface is an industry standato, 
one can easily modify the machine. For example, one can add different components 
and peripherals to the machine as the system design evolves, or can easily 

25 add/design next-generation components as the technology evolves. Furthennore, 
because the components support a common industry-standard services layer, one 
can incorporate into the computing machine's software an existing software module 
that Implements the corresponding protocol. Therefore, one can interface the 
components with little effort because the Interface design is essentially already in 

30 place, and thus can focus on designing the portions (e.g., software) of the machine 
thai cause the machine to perform the desired functionfs}. 
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[34J But unfortunately, there are no known industry-standard services layers 

for components, such as PLICs, used to form hardwired pipelines such as the 
pipeline W of RG* 2, 

£35] Consequently, to design a pipeline having multiple PLICs, one typically 

spends a significant amount of time and exerts a significant of drt designing 'from 
scratch" and debugging the services layer of the communication interface between 
the PUCs. Typically, such an ad hoc services layer depends on the parameters of 
the date being transferred between the PLICs. Likewise, to design a pipeline that 
interfaces to a processor, one would have to spend a significant amount of time and 
exert a significant effort In designing and debugging the services layer of the 
communication interface between the pipeline and the processor. 

[36] Similarly, to modify such a pipeline by adding a PLIC to it, one typically 

spends a significant amount of time and exerts a significant effort designing and 
debugging the services layer of the communication interface between the added 
PLIC and the existing PLICs, Likewise, to modify a pipeline by adding a processor, 
or to modify a computing machine by adding a pipeline, one would have to spend a 
significant amount of time and exert a significant effort in designing and debugging 
the services layer of the communication interface between the pipeline and 
processor. 

|3?3 Consequently, referring to FIGS, 1 and 2, because of the difficulties in 

interfacing multiple PLICs and In interfacing a processor to a pipeline, one is often 
forced to make significant tradeoffs whan designing a computing machine. For 
example, with a processor-based computing machine, one is forced to trade number- 
crunching speed and design/modification flexibility for complex decision-making 
ability. Conversely, with a hardwired pipeline-based computing machine, one is 
forced to trade eompiex-dedsiommaking ability and design/modification flexibility for 
number-crunching speed. Furthermore, because of the difficulties in Interfacing 
multiple PLICs, it Is often impractical for one to design a pipeline-based machine 
having more than a few PLICs. As a result, a practical pipeline-based machine often 
has limited functionality. And because of the difficulties In interfacing a processor to 
a PLIC, It would be Impractical to Interface a processor to more than one PLIC, As a 
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result, the benefits obtained by combining a processor and a pipeline would be 
minimal. 

[38J Therefore, a need has arisen for a new computing archiectuf© that 

allows one to combine the decision-making ability of a processor-based machine 
with the number-crunching speed of a hardwired-plpefine-based machine. 

Summary 

|39J According to an embodiment of the invention, a pipeline accelerator 

Includes a bus and a plurality of pipeline units each coupled to the bus and each 
including at least one respective hardwired-pipeline circuit. 

1403 By including a plurality of pipeline units in the pipeline accelerator, one 

can Increase the accelerator's data-processing performance as compared to a 
single«pipalina~unit accelerator. Furthermore, by designing the pipeline units so that 
they communicate with each other and with other peers via a common bus, one can 
alter the number of pipeline units, and thus alter the configuration and functionality of 
the accelerator, by merely coupling or uncoupling pipeline units to or from toe bus. 
This eliminates the need to design or redesign the pipeline-unit Interfaces each time 
one alters one of the pipeline units or alters the number of pipeline units within the 
accelerator. 

Brief DescRsPTsor* of the Drawings 

[41] FIG, 1 is a block diagram of a computing machine having a 

conventional multi-processor architecture. 

[42J 2 is a block diagram of a conventional hardwired pipeline. 

|43| FIG. 3 Is a block diagram of a computing machine having a peer-vector 

architecture according to an embodiment of the invention. 

[44] FIG. 4 Is a block diagram of a pipeline unit of the pipeline accelerator of 

FIG. 3 according to an embodiment of the Invention, 

f45| FIG. 5 is a block diagram of a pipeline unit of the pipeline accelerator of 

FIG, 3 according to another embodiment of the invention. 
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[48J FfG. 8 is a block diagram of the pipeline accelerator of FIG. 3 including 

muitipie pipeline units according to an embodiment of the invention. 

|47] FIG, 7 is a block diagram of the pipeline accelerator of FIG. 3 including 

muitipie pipeline unite according to another embodiment of the invention. 

|48| FIO. 8 is a block diagram of the pipeline accelerator of FIG, 3 Including 

groups of multiple pipeline units according to an embodiment of the invention. 

DsTAiLso Description 

[49] FIG,. 3 is a schematic block diagram of a computing machine 40, which 

has a peer-vector architecture according to an embodiment of the Invention. In 
addition to a host processor 42, the peer-vector machine 40 Includes a pipeline 
accelerator 44, which performs at least a portion of the data processing, and which 
thus effectively replaces the bank of coprocessors 14 In the computing machine 10 
of FIG. 1 . Therefore, the host-processor 42 and the accelerator 44 (or units thereof 
as discussed below) are "peers" that can transfer data vectors back and forth. 
Because the accelerator 44 does not execute program instructions, it typically 
performs mathematically intensive operations on data significantly faster than a bank 
of coprocessors can for a given clock frequency. Consequently, by combining the 
decision-making ability of the processor 42 and the number-crunching ability of the 
accelerator 44, the machine 40 has the same abilities as, but can often process data 
faster man, a conventional computing machine such as the machine 10. 
Furthermore, as discussed below, providing the accelerator 44 with a communication 
interface that is compatible with the communication interface of the host processor 
42 facilitates the design and modification of the machine 40, particularly where the 
processor's communication interface is an Industry standard. And where the 
accelerator 44 includes muitipie pipeline units (e.g., PUC-based circuits}, providing 
each of these units with the same communication interface facilitates the design and 
modification of the accelerator, particularly where the communication interfaces are 
compatible with an industry-standard interface, Moreover, the machine 40 may also 
provide other advantages as described below and in the previously cited patent 
applications. 
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[SO] Sill referring to FIG. 3, in addition to the host processor 42 and the 

pipeline accelerator 44, the peer-vector computing machine 40 includes a processor 
memory 4$, an Interface memory 48 f a pipeline bus 50, one or more firmware 
memories 52, an optional raw-data input port 54, a processed-data output port 58, 
5 and an optional router 51 

[51] The host processor 42 Includes a processing unit 52 and a message 

handler 54, and the processor memory 45 includes a processing-unit memory 55 
and a handler memory 55, which respectively serve as both program and working 
memories for the processor unit and the message handler. The processor memory 
1 0 45 also includes an accelerator-configuration registry 70 and a 

message-configuration registry 72, which store respective configuration data that 
allow the host processor 42 to configure the functioning of the accelerator 44 and the 
format of the messages that the message handier 54 sends and receives, 

£523 The pipeline accelerator 44 is disposed on at least one PUC (FIG. 4} 

15 and includes hardwired pipelines 74? - 74„, which process respective data without 
executing program: instructions. The firmware memory 52 stores the configuration 
firmware for the accelerator 44 if the accelerator 44 is disposed on multiple PLICs, 
then these PLICs and their respective firmware memories may be disposed In 
multiple pipeline units, which are discussed further below in conjunction with FIGS. 4 
20 ~ 8. Alternatively, the accelerator 44 may be disposed on at least one ASIC, and 
thus may have internal interconnections that are unconflgurabie once the ASIC is 
formed, in this aitematlve, the machine 40 may omit the firmware memory 52. 
Furthermore, although the accelerator 44 is shown Including multiple pipelines 74?- 
74 m if may include only a single pipeline. In addition, although not shown, the 
25 accelerator 44 may include one or more processors such as a digital-signal 

processor {DSP). Moreover, although not shown, the accelerator 44 may Include a 
data input port and/or a data output port. 

[53] And although the host processor 42 and pipeline accelerator 44 are 

discussed as being disposed on different ICs, the host processor and pipeline 
30 accelerator may be disposed on the same IC. 

|54J The general operation of the peer-vector machine 40 is discussed in 

previously cited U.S. Patent App. Serial No, 10/584,102 entitled IMPROVED 
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COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, tile 
structure and operation of the host processor 42 is discussed in previously cited U.S. 
Patent App, Serial No.1 0/884,053 entitled COMPUTING MACHINE HAVING 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, and the structure and operation of the pipeline accelerator 44 is 
discussed in previously died U.S. Patent App. Serial No. 10/083.929 emitted 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD and below in conjunction with FIGS. 4 ~8. 

M FIG. 4 Is a block diagram of a unit 78 of the pipeline accelerator 44 of 

FIG. 3 according to an embodiment of the Invention. 

|5©3 The accelerator 44 Includes one or more such pipeline units 78 (only 

one shown in FIG. 4), each of which includes a pipeline circuit 80, such as a PLSC or 
an ASIC. As discussed further below and in previously cited U.S. Patent App, Serial 
No. 107683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD, each pipeline unit 78 is 
a "peer" of the host processor 42 (FIG. 3} and of the other pipeline units of the 
accelerator 44. That is, each pipeline unit 78 can communicate directly with the host 
processor 42 or with any other pipeline unit. Thus, this peer-vector architecture 
prevents data "bottlenecks" that otherwise might occur if all of the pipeline units 78 
communicated through a central location such as a master pipeline unit (not shown) 
or the host processor 42. Furthermore, this architecture allows one to add or remove 
peers from the peer-vector machine 40 (FIG. 3) without significant modifications to 
the machine. 

|57J The pipeline circuit 80 includes a communication interface 82, which 

transfers data between a peer, such as the host processor 42 (FIG. 3), and the 
following other components of the pipeline circuit: the hardwired pipelines 74t-74» via 
a communication shelf 84, a pipeline controller 88, an exception manager 88, and a 
configuration manager §0, The pipeline circuit 80 may also Include an 
industry-standard bus interface 91 and a communication bus 93, which connects the 
Interface 82 to the Interface 91. Alternatively, the functionality of the interface 81 
may be Included within the communication interface 82 and the bus 93 omitted. 
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158} By designing the components of the pipeline circuit 80 as separate 

modules, one can often simplify the design of the pipeline circuit. That is, one can 
design and test each of these components separately, and then integrate them much 
like one does when designing software or a processor-based computing system 
5 (such as the system W of FIG, 1 )> In addition, one can save in a library (not shown) 
hardware description language (HDL) that defines these components — particularly 
components, such as the communication interface B2, that designers will probably 
use frequently in other pipeline designs — thus reducing the design and test time of 
future pipeline designs that use the same components. That is, by using the HDL 

10 from the library, the designer need not redesign previously implemented components 
from scratch, and thus can focus his efforts on the design of components that were 
not previously implemented, or on the modification of previously Implemented 
components. Moreover, one can save in the library HDL that defines multiple 
versions of the pipeline circuit 80 or multiple versions of the entire pipeline 

1 6 accelerator 44 so that one can pick and choose among existing designs. 

[§9f Still referring to FIG. 4, the eommurwcatian interface 82 sends and 

receives (via the bus interface 91 of present) data in a format recognized by the 
message handler 64 (FIG. 3} } and thus typically facilitates the design and 
modification of the peer-vector machine 40 (FIG, 3). For example, If the data format 

20 Is an industry standard such as the Rapid I/O format, then one need not design a 
custom interface between the host processor 42 and the pipeline unit 70 . 
Furthermore, by allowing the pipeline unit 78 to communicate with other peers, such 
as the host processor 42 (FIG. 3), via the pipeline bus SO Instead of via a non-bus 
interface, one can change the number of pipeline units by merely connecting or 

25 disconnecting them (or the circuit cards that hold them) to the pipeline bus Instead of 
redesigning a non-bus interface from scratch each time a pipeline unit is added or 
removed. 

[60J The hardwired pipelines 74i~74 fl perform respective operations on data 

as discussed above in conjunction with FIG. 3 and in previously cited U.S. Patent 
30 App, Serial Nos. 1 0/884,1 02 entitled IMPROVED COMPUTING ARCHITECTURE 
AND RELATED SYSTEM AND METHOD and 10/883,929 entitled PIPELINE 
ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND RELATED 
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SYSTEM AND METHOD, and the communication shell 84 interfaces the pipelines to 
the other components of the pipeline circuit 80 and to other circuits (such as a data 
memory B2 d iscussed below) of the pipeline unit 78. 

P1] The controller 8$ synchronizes the hardwired pipelines 74fJ4 a in 

6 response to SYNC signals and special pipeline-bus communications (i.e., "events") 
from other peers, and monitors and controls the sequence in which the pipelines 
perform their respective data operations. For example, a peer, such as the host 
processor 42, may pulse a SYNC signal or send an event to the pipeline unit 78 via 
the pipeline bus 50 to indicate that tie peer has finished sending a block of data to 

1 0 the pipeline unit and to cause the hardwired pipelines 74iJ4„ to begin processing 
this data. Typically, a SYNC signal is used to synchronize a time-critical operation, 
and an event is used to synchronize a non-time-critical operation. Typically, an 
event is a data-less communication that Is often called a "doorbell". But an event 
may include data, in which case if is often called an "©vent message; SYNC signals 

1 5 and events are discussed further in previously cited U.S. Patent App, Serial No. 
107863,029 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD. 

|62J The exception manager 88 monitors the status of the hardwired 

pipelines 74r74 m the communication interface 82, the communication shell 84, the 

20 controller 8§, and the bus interface 91 (If present), and reports exceptions to the host 
processor 42 (FIG. 3). For example, if a buffer in the communication interface 82 
overflows, then the exception manager 88 reports this to the host processor 42. The 
exception manager may also correct, or attempt to correct, the problem giving rise to 
the exception. For example, for an overflowing buffer, the exception manager 88 

25 may increase the size of the buffer, either directly or via the configuration manager 
90 as discussed below, 

|S3J The configuration manager 90 sets the sot configuration of the 

hardwired pipelines 74t~74 0 , the communication interface 82, the communication 
shell 04, the controller 8§, toe exception manager 88, and the interface 91 (if 
30 present) in response to soft-configuration data from the host processor 42 (FIG. 3) — 
as discussed in previously cited U.S. Patent App. Serial Ho, 10/884,102 entitled 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
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METHOD, the hard configuration denotes the actuai topology, on the transistor and 
circuit-block level, of the pipeline circuit 80, and the soft configuration denotes the 
physical parameters (e.g., data width, table size) of the hard-configured components. 
That Is, soft configuration data Is similar to the data that can be loaded into a register 
5 of a processor (not shown in FIG. 4} to set the operating mode (e.g., burst-memory 
mode) of the processor. For example, the host processor 42 may send 
soft-configoratfon data that causes the configuration manager 90 to set the number 
and respective priority levels of data and event queues in the communication 
interface 82, The exception manager 88 may also send soft-configuration data that 
1 0 causes the configuration manager $0 to, e,g, s increase the size of an overflowing 
buffer in the communication interface 82, 

M The industry-standard bus interface $1 is a conventional bus-interface 

circuit that reduces the size and complexity of lie communication interface 82 by 
effectively offloading some of the Interface circuitry from the communication 

1 5 interface. Therefore, if one wishes to change the parameters of the pipeline bus 50 
or router 61 (FIG. 3), then he need only modify the interface 91 and not the 
communication Interface 82, Alternatively, one may dispose the interface $1 in an IC 
(not shown) that is external to the pipeline circuit SO, Offloading the interface 01 
from the pipeline circuit 80 frees up resources on the pipeline circuit for use in, e.g., 

20 the hardwired pipelines 74 r 74„ and the controller 88. Or, as discussed above, the 
bus interface 91 may be part of the communication interface 82, 

[65J Still referring to Ft©. 4, in addition to the pipeline circuit 80, toe pipeline 

unit 78 of the accelerator 44 Includes the data memory 02, and, if the pipeline circuit 
is a FLIC, a firmware memory 52. 

25 [66J The data memory $2 buffers data as it flows between another peer, 

such as the host processor 42 (FIG, 3), and the hardwired pipelines 74i~?4 m and is 
also a working memory for the hardwired pipelines, The communication interface B2 
interfaces the data memory 02 to the pipeline bus 50 (via the communication bus §4 
and industry-standard interface 91 if present), and the communication shell 84 

30 interfaces the data memory to toe hardwired pipelines 74 r 74„. 

|87| The data memory 02 (or other portion of the pipeline unit 78) may also 

store a profile of the pipeline unit, The profile describes the pipeline unit 78 
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sufficiently for the host processor 42 (FIG. 3} to appropriately configure Itself, the 
pipeline unit, and other peers of the peer-vector machine 40 {FIG, 3) for 
intercommunication. For example, the profile may identify the data operations and 
communication protocols thai the pipeline unit 78 Is capable of implementing. 
Consequently, by reading the profile during initialization of the peer-vector machine 
40, the host processor 42 can properly configure the message handler 04 (F83. 3} to 
communicate with the pipeline unit m This technique is analogous to the "plug and 
play" technique by which a computer can configure itself to communicate with a 
newly installed peripheral such as a disk drive. Configuration of the host processor 
42 and pipeline unit 78 are discussed further in previously cited U.S. Patent App. 
Serial Nos. 10/884,102 entitled IMPROVED COMPUTING ARCHITECTURE AMD 
RELATED SYSTEM AND METHOD and 10/684,057 entitled PROGRAMMABLE 
CIRCUIT AND RELATED COMPUTING MACHINE AND METHOD, 

[883 As discussed above in conjunction with FIG. 3, where the pipeline 

circuit 80 is a PUG, the flmiwar© memory $2 stores the f irmware that sets the hard 
configuration of the pipeline circuit. The memory 52 loads the firmware into the 
pipeline circuit 8$ during the configuration of the accelerator 44, and may receive 
modified firmware from the host processor 42 (FIG. 3} via the communication 
Interface $2 during or after the configuration of the accelerator. The loading and 
receiving of firmware is further discussed in previously cited U.S. Patent App. Serial 
Nos. 10/604,102 entitled IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD, 10/684,053 entitled COMPUTING MACHINE 
HAVING IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM 
AND METHOD, and 10/684,097 entitled PROGRAMMABLE CIRCUIT AND 
RELATED COMPUTING MACHINE AND METHOD. 

[69| Still referring to FIG, 4, the pipeline unit 78 may include a circuit board 

or card 98 on which are disposed the pipeline circuit 80, data memory 92, and 
firmware memory $2. The circuit board 98 may be plugged info a pipeline-bus 
connector (not shown) much like a daughter card can be plugged Into a slot of a 
mother board in a personal computer (not shown). Although not shown, the pipeline 
unit 78 may Include conventional ICs and components such as a power regulator 
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and a power sequencer; these ICs/components may also be disposed on the card 98 
as is known, 

[70J Further details of the structure and operation of the pipeline unit 78 are 

discussed in previously cited U.S. Patent App. Serial Mo. 10/883,929 entitled 
5 PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD. 

[711 FIG. § is a block diagram of a pipeline unit 100 of the pipeline 

accelerator 44 of FI0. 3 according to another embodiment of the invention. The 
pipeline unit 109 is similar to the pipeline unit 78 of FIG. 4 except that the pipeline 

tO unit 1 00 includes multiple pipeline circuits 80 — here two pipeline circuits 80a and 
80b. Increasing the number of pipeline circuits $0 typically allows an increase in the 
number n of hardwired pipelines 74r74 m and thus an increase in the functionality of 
the pipeline unit 100 as compared to the pipeline unit 78, Furthermore, the pipeline 
unit 100 includes a firmware memory §2«t for the pipeline circuit 80a and a firmware 

1 § memory $2b for the pipeline circuit 80b. Alternatively, the pipeline circuits 80a and 
80b may share a single firmware memory. 

[723 In the pipeline unit 100, the services components, i.e., the 

communication interface 82, the controller 88, the exception manager 88, the 
configuration manager 90, and the optional industry-standard bus Interface $1, are 

20 disposed on the pipeline circuit 80a, and the pipelines 74r74„ and the 

communication shell 84 are disposed on the pipeline circuit 80h, By locating the 
services components and the pipelines 74 r 74 a on separate pipeline circuits 80a and 
80b, respectively, one can include a higher number ft of pipelines and/or more 
complex pipelines than he/she can where the service components and the pipelines 

25 are located on the same pipeline circuit Alternatively, the portion of the 

communication shell 84 that interfaces the pipelines 74 r 74 n to the interface 82 and 
to the controller 88 may he disposed on the pipeline circuit 80a. 

|73J Further details of the structure and operation of the pipeline unit 100 

are discussed in previously cited U S, Patent App. Serial No. 10/883,929 PIPELINE 
30 ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD. 
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[74| FIG. § is a block diagram of the accelerator 44 of FIG. 3 having 

multiple pipeline units 78 (FIG. 4) or 100 (FIG. 5) according to an embodiment of the 
invention. For clarity, the accelerator 44 is discussed as having multiple pipeline 
units 78? ~ 78 m it being understood that the accelerator may include multiple pipeline 
5 units 100 or a combination of units 78 and 10®. By including multiple pipeline units 
78, one can increase the functionality and processing power of the accelerator 44 as 
compared to an accelerator having only one pipeline unit. Furthermore, because 
each pipeline unit 78 typically has a common Industry-standard interface, one can 
easily modify the accelerator 44 by adding or removing pipeline units. 

1 0 |TS] In one implementation of the multiple-pipeline accelerator 44, the 

industry-standard bus Interface 91 Is omitted from each pipeline unit 7$$~ 78 m and a 
single external (to the pipeline units) Interface 91 and communication bus 94 are 
common to all of the pipeline units, Including a single external bus interface $1 frees 
up resources on the pipeline circuits 80 (FIG, 4} as discussed above in conjunction 

1 5 with FIG. 4. The pipeline units 78i ~ 78 n may all be disposed on a single circuit 
board (not shown In FIG. 6), each pipeline unit may be disposed on a respective 
circuit board, or groups of multiple pipeline units may be respectively disposed on 
multiple circuit boards. In the latter two Implementations, the bus interface 91 is 
disposed on on© of the circuit boards. Alternatively, the pipeline units 78? - 78„ may 

20 each include a respective industry-standard bus interface 01 as discussed above in 
conjunction with FIG. 4, and thus may each communicate directly with the pipeline 
bus 59 or router 81 (FIG. 3). In this implementation, the pipeline units 78? ™ 78» may- 
be disposed on a single or multiple circuit boards as discussed above. 

|76J Each of the pipeline units ?8i ™ 78 n is a peer of the host processor 42 

25 (FIG. 3) and of each other. That is, each pipeline unit 78 can communicate directly 
with any other pipeline unit via the communication bus 94, and can communicate 
with the host processor 42 via the communication bus 94, the bus interface 91, the 
router 81 (If present), and the pipeline bus 50, Alternatively, where the pipeline units 
78? - 78 n each include a respective bus interface 91, then each pipeline unit can 
30 communicate directly with the host processor 42 via the router 81 (If present) and the 
pipeline bus 58. 
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[77] The operate of the mui-pipeline-unit accelerator 44 Is now described 

by way of tec examples, 

[783 to a first example, the pipeline unit 78i transfers data to the pipeline 

78 m which processes the data In a time-critical manner; thus, the pipeline units 70? 
5 and 78„ use one or more SYNC signals to synchronize the data transfer and 

processing. Typically, a SYNC signal $$ fast enough to trigger a time-crfticaf function, 
hut requires significant hardware resources; comparatively, an event typically is not 
fast enough to trigger a time-critSca! function, but requires significantly fewer 
hardware resources, As discussed in previously cited U.S. Patent App, Serial No. 

10 10/683,929 ®rmm PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 

ARCHITECTURE AND RELATED SYSTEM AND METHOD, because a SYNC signal 
is rooted directly from pear to peer, it can trigger a function mora quickly than an 
event which traverses, &>g, t the pipeline bus 50 (BO* 3), and the communication 
bus 94, But because they are separately routed, the SYNC signals require 

15 dedicated circuitry, such as routing lines and buffers of the pipeline circuit SO (FIXS. 
4% Conversely, because they use the listing data-transfer infrastructure (e.g. the 
pipeline bus 50 and the communication bus $4% the events require fewer dedicated 
hardware resources, Consequently, designers tend to use events to trigger ali but 
the most time-critical functions. 

20 [79$ First, the pipeline unit Tfc sends data to the pipeline unit 7% by driving 

the data onto the communication bus $4 Typically, the pipeline unit 78i generates a 
message thai includes the data and a header that contains the address of the 
pipeline unit 78 n » If the pipeline u nit 78i were to send the data to multiple pipeline 
units 78, then it may do so in one of two ways. Specifically, the pipeline unit 78i may 

25 sequentially send separate messages to each of the destination pipeline units 78,. 
each message including a header containing the address of a respective destination 
unit. Alternatively, the pipeline unit 70? may simultaneously send the data to each of 
the destination pipeline units 78 by including in single message the data and a 
header containing the addresses of each destination pipeline unit. The sending of 

30 data is further discussed in previously cited U.S. Patent App. Serial No. 10/683,929 
entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD. 
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|S0| Next, the pipeline unit 7%, receives the data, Because the pipeline 

units 78i - 78„ are each coupled to the common communication bus B4> each 
pipeline unit 78$ - ?&„ determines whether or not it is an intended recipient of the 
data. For example, each pipeline unit 7%~ 78 n determines whether Its address is 
5 included In the header of the message, In this example, the units 78% ~ 7$»»* 

determine that they are not intended recipients of the data, and # *us ignore the data, 
he., do not load the data into their data memories 02 (FIG. 4), Conversely, the 
pipeline unit 7$ a determines that it is an Intended recipient of the data, and thus 
loads the data into Its data memory 92. The receiving of data is discussed further In 
1 0 U.S. Patent App. Serial No. 1 0/883,929 entitled PIPELINE ACCELERATOR FOR 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD. 

|81J Then, when the pipeline unit 78^ is ready to process the received data, 

a peer, such as the pipeline unit 78i, or an external device {not shown) pulses a 

15 SYNC signal to cause the pipeline unit 7B„ to process the data in a timely manner. 
There exist a number of techniques by which the peer/device that pulses the SYNC 
signal may determine when the pipeline unit 78 n is ready to process the received 
data. For example, the peer/device may merely pulse the SYNC signal a 
predetermined time after the pipeline unit 7$i sends the data. Presumably, the 

20 predetermined time is Song enough to allow the pipeline unit 78» to receive and load 
the data into its data memory 92 (FIG, 4). Alternatively, the pipeline unit 78 st may 
pulse a SYNC signal to Inform the peer/device that it is ready to process the received 
data, 

£82J Next, in response to the pulsed SYNC signal; the pipeline unit 78„ 

25 processes the received data. The processing of data by a pipeline unit is discussed 
further in previously cited U.S. Patent App. Serial No. 10/683,929 entitled PIPELINE 
ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD, 

|83| Then, when the pipeline unit 78 tJ Is finished processing the data, a 

30 peer, an external device (not shown), or the unit 78 n itself may pulse a SYNC signal 
to notify the pipeline unit 7$f to send more data. 

21 
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|84J In a second example, the host processor 42 (FIG, 3) transfers data to 

the pipeline 7£ m which processes the data in e non-time-critica! manner; thus the 
host processor and the pipeline unit 7§ n use one or more amenta to synchronize the 
data transfer and processing for the reasons discussed above. 

5 IBB] First, the host processor 4$ (FIO* 3) sends data to the pipeline unit 7B n 

by driving the data onto the pipeline bus SO {Fl<3, 3). Typically, the host processor 
42 generates a message that includes the data and a header containing tie address 
of the pipeline unit 78& If the host processor 42 were to send the data to multiple 
pipeline units 78, then it may do so in one of the two ways discussed above in 
1 0 conjunction with the first example. 

|8$] Next, the pipeline unit 7B n receives the data from the pipeline bits SO 

(FIG* 3) via the industry-standard bus interface §1 and the communication bus 94> 
Because the pipeline units 7% - 7B Q are each coupled to the common 
communication bus 94, each pipeiine unit determines whether it is an Intended 
15 recipient of the data m the manner discussed above in conjunction with the first 
example, 

{81} Thee, when the pipeline unit ?8 n is ready to process the received data, 

a peer, such as the host processor 42 (FIG, 3>, or an externa! device (not shown), 
generates an event on the pipeline bys §0 or directly on the communication bus 94 

20 to cause the pipeiine unit 78 n to process the data in a timely manner, There exist a 
number of techniques by which the peer/device that generates the event may 
determine when the pipeline unit T8» Is ready to process the received data. For 
example, the peer/device may merely generate the event a predetermined time after 
the host processor 42 sends the data. Presumably, the predetermined time Is long 

25 enough to allow the pipeline unit 78 t) to receive and load the data into Its data 
memory 92 (FIG. 4). Alternatively, the pipeline unit 78 >t may generate an event to 
inform the peer/device that it is ready to process the received data. 

IB&l Next, the pipeiine unit 78„ receives the event. The receiving of an 

event is discussed in previously cited U.S. Patent App. Serial No. 10/683,826 entitled 
30 PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD, 
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[8S| Then, in response to the received event, the pipeline unit 78„ 

processes the received data. The processing of data by a pipeline unit 78„ is 
discussed further in previously cited U.S. Patent Application Serial No, 10/883,929 
entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
5 ARCHITECTURE AND RELATED SYSTEM AND METHOD. 

[SOJ Next, when the pipeline unit 78 n is finished processing the data, a peer, 

an external device (not shown), or the unit 78 tl itself may generate an event to notify 
the host processor 42 (FIG. 3} to send more data. 

[91 J Still referring to FIG. ®, alternative implementations of the accelerator 

10 44 are contemplated. For example, although the above-discussed first and second 
examples of operation respectively use SYNC signals and events exclusively, it is 
contemplated that the accelerator 44 can use both SYNC signals and events in 
combination. Furthermore, other peers can use one or more of the multiple pipeline 
units 78 or 100 merely for bulk storage of data in their respective data memories 92. 
1 5 In addition, a designer may replace the host processor 42 (FIG. 3) with one or more 
of the pipeline units 78 or W0 S which together form a "host" peer that performs the 
functions of the host processor. Moreover, one or more of the pi peline units 78 or 
100 may act as one or more message-distribution peers. For example, suppose that 
the host processor 42 generates a message for transmission to multiple subscriber 
20 peers. The host processor 42 may send the message to a message-distribution 
peer, which then distributes the message to each of the subscriber peers. 
Consequently, the message-distribution peer, not the host processor 42, undertakes 
the burden of distributing the message, and thus allows the host processor to devote 
more time and resources to other tasks. 

26 £92] Ff<3« 7 Is a block diagram of the accelerator 44 (FIG. 3) having multiple 

pipeline units 78 (FIG. 4} or 100 (FIG. 5) according to another embodiment of the 
invention. 

J93J The accelerator 44 of FIG. 7 is the same as the accelerator 44 of FIG, 

8, except that the accelerator 44 of FIG. 7 includes a communication-bus router HO 
30 for routing data between the pipeline units 78 ? ~ 78 n and other peers, such as the 
host processor 42 (FIG. 3), and devices (not shown) that are coupled to the pipeline 
bus 50 (FIG, 3). For clarity, the accelerator 44 of FIG. 7 is discussed as having 
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multiple pipeline units 78* - 7B m if being understood thai the accelerator may include 
multiple pipeline units 10$ or a combination of umis 78 and 100, 

|W| The communicatforvbus router 110 is coupled to the ptpeime units 7Bi 

~~ 7B n via respective branches 94i ~ 94 n of the communication bus 94 : and is coupled 
8 to the industry-standard bus interface 0f (if present) via a bus 112, Alternatively* as 
discussed above in conjunction with FIG, 6 f each pipeline unit 7§* ~ 70 fl may include 
a respective interface 9? on board, and thus the external interface 91 can be omitted 
such that the router 110 is directly coupled to the pipeline bus SO (or router $f if 
present) of FIG, 3, 

1 0 [953 The router 110 routes signals from the pipeline bus 50 (FIG. 3) to the 

respective destination pipeline unit or units 78? ~ 70^ and also routes signals from a 
source pipeline unit to one or more destination pipel ine u nits or to the pipeline bus. 
Consequently, the router f 10 offloads from each of the pipailne units TBi-TB^ the 
function of determining whether a signal on the communication hue §4 Is Intended for 

15 that pipeline unit, This offloading may free up resources on the pipeline circuit 80 
(FIG, 4} of each pipeline unit 7Bi ~ 7$ m and thus may allow an increase in the 
functionality of each pipeline unii 

|983 Still referring to FIG, 7\ the operation of the multi-pipeline-unit 

accelerator 44 with the router 110 is now described. Because the operation is 
20 similar to that described above for the accelerator 44 of FIG* 8, the below description 
highlights the operational differences between the accelerators of FIGS. 8 and 7, 

[97] In a first example, the pipeline unit 78* transfers data to the pipeline 

7$ m which processes the data in a time-critical manner; thus, the pipeline units 7$i 
and 7&k use one or more SYNC signals to synchronize the date transfer and 
25 processing as discussed above in conjunction with the first example of FIG. 8* 

|08] First, the pipeline unit 7Bi sends data to the pipeline unit 7S n by driving 

the data onto the branch $4i of the communication bus. Typically, the pipeline unit 
7$i generates a message that Includes the data and a header that contains the 
address of the pipeline unit 7B t} , 

30 |99J Next the muter 110 receives the data, determines tMi the destination 

of the data is the pipeline unit 78 m and drives the data onto the branch 94* of the 
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communication bus. Typically, the router 110 determines the destination of the data 
by analyzing the header of the message containing the data and extracting the 
destination address from the header. Consequently, because the router 110 
determines the proper destination of the data, the pipeline unit 7B„ can merely 
5 accept the data from the router without determining whether it Is an Intended 

recipient of the data. Alternatively, the pipeline 7B„ may determine whether it is an 
Wended recipient of the data, and generate an exception (discussed in previously 
cited U.S. Patent App. Serial Nos. 107684,102 entitled IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD, 10/884,053 entitled 

10 COMPUTING MACHINE HAVING IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD, and 10/683,929 entitled PIPELINE 
ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD if it Is not an intended recipient. The pipeline unit 7% can 
send this exception to the host processor 42 (FIG, 3} via the router 110, the 

15 industry-standard bus Interface 91 (If present), the router 61 (if present), and the 
pipeline bus 50 (FIG. 3). 

[100] Then, the pipeline unit 78 n loads the data from the bus branch 94„, 

The loading of data by a pipeline unit is further discussed In previously cited U.S. 
Patent App. Serial No. 10/883,929 entitled PIPELINE ACCELERATOR FOR 
20 IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD. 

11011 Next, when the pipeline unit 78„ is ready to process the received data, 

a peer, such as the pipeline unit 7%, or an externa! device (not shown) pulses a 
SYNC signal to cause the pipeline unit 7B„ to process the data in a timely manner as 
25 discussed above in conjunction with the first example of FIG. 6. 

|1G2J Then, in response to the pulsed SYNC signal, the pipeline unit 

processes the received data as discussed above in conjunction with the first 
example of FIG. 6. 

|1033 Next, when the pipeline unit 7B n is finished processing the data a peer, 

30 an externa! device (not shown), or the unit 7B n itself may pulse a SYNC signal to 
notify the pipeline unit 78i to send mom data. 

25 
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f 1041 In a second example, the host processor 42 (FIG. 3} transfers data to 

the pipeline 78„, which processes the data in a non-time-crtticai manner; thus the 
host processor and the pipeline unit 78„ use one or mora events to synchronize the 
data transfer and processing for the reasons discussed above in conjunction with 
5 FIG. 6, 

|105J First, the host processor 42 (FIG, 3} sends data to the pipeline unit 7B n 

by driving the data onto the pipeline bus SO {FIG, 3). Typically, the host processor 
42 generates a message that includes the data and a header containing the address 
of the pipeline unit 78* 

1 0 £1 081 Next, the router 1 10 receives the data from the pipeline bus SO (FIG. 3} 

via the Industry-standard bus interface 91 (if present) and the bus 11 2, 

|1 07] Then, the router 1 10 determines that the destination of the data is the 

pipeline unit 7B m and drives the data onto the branch 94 n of the communication bus. 
Typically, the router 110 determines the destination of the header as discussed 

1 5 above in conjunction with the first example of FIG, 7. Consequent because the 
router 110 determines the proper destination of the data, the pipeline unit 7S„ can 
merely accept the data from the router without determining whether it is an intended 
recipient of the data. Alternatively, the pipeline 7B n may determine whether i Is an 
intended recipient of the data, generate an exception (discussed In previously cited 

20 U.S. Patent App. Serial Nos. 10/884,102 entitled IMPROVED COMPUTING 

ARCHITECTURE AND RELATED SYSTEM AND METHOD, 10/684,053 entled 
COMPUTING MACHINE HAVING IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD, and 10/683,929 entitled PIPELINE 
ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND RELATED 

25 SYSTEM AND METHOD if it Is not an intended recipient, and send the exception to 
the host processor 42 (FIG. 3) as discussed above In conjunction with the second 
example of FIG. 6. 

[108] Next, the pipeline unit 78 n loads the data from the bus branch 94*. The 
loading of data by a pipeline unit is further discussed in previously cited U.S. Patent 
30 App. Sehai No. 10/883,029 entitled PIPELINE ACCELERATOR FOR IMPROVED 
COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD. 

26 
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[1 09] Then, when the pipeline unit 78 n is ready to process the received data, 
a peer, such as the host processor 42 (FIG. 3), or an externa! device (not shown), 
generates an event on the pipeline bus 50 or on one of the branches 94t - 04„., of 
the communication bus to cause the unit 7S„ to process the data in a timely manner 
5 as discussed above in conjunction with the second example of FIG. 6. 

|1 1 0| Next, the router 110 receives the event, determines that it is intended 

for the pipeline unit ?B„, and drives the event onto the bus branch 94 s , 

[1 1 1| Then, the pipeline unit TB a loads the event from the bus branch 94, 
The loading of an event by a pipeline unit 78 Is discussed In previously cited U.S. 
1 0 Patent App. Serial No. 1 0/683,929 entitled PIPELINE ACCELERATOR FOR 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD. 

11123 Next, in response to the received event, the pipeline unit 78„ processes 

the received data. 

1 5 |1 1$| Then, when the pipeline unit 78 n Is finished processing the data, a 

peer, an external device (not shown), or the unit 7$t, itself may generate an event to 
notify the host processor 42 (FIG. 3} to send more data. 

11141 Still referring to FIG. 7, although the first and second examples of 

operation respectively use SYNC signals and events exclusively, I Is contemplated 
20 that the accelerator 44 can use a combination of both SYNC signals and events. 

[1 153 FIG. 8 is a block diagram of the accelerator 44 of FIG. 3 including 

multiple groups 120 of multiple pipeline units 78 (FIG. 4) or 1 00 (FIO, $} according to 
an embodiment of the invention, including multiple groups 120 of pipeline units 
Increases the funofionaly of the accelerator 44, and allows a designer to Increase 

25 the accelerator's efficiency by grouping pipeline units that perform related 

operations. For clarity, the accelerator 44 of FIG. a is discussed as having multiple 
pipeline units 78, it being understood that the accelerator may Include multiple 
pipeline units 100 or a combination of units 78 and 100. Furthermore, the pipeline 
units 78 do not include industry-standard bus interfaces §1 (this interface Is external 

30 in this embodiment), although they may in another embodiment. 
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|i iSJ The accelerator 44 includes six groups 120f ~ 1 20§ of pipeline units 78, 

each group having three pipeline units and a respective tntra-group 
communication-bus router 110i - 110$ that interconnects the pipeline units to each 
other and to the other pipeline-unit groups. Although the accelerator 44 is discussed 
as including six groups f20 t ~ 129$ of three pipeline units 7$ each, other 
Implementations of the accelerator may include virtually any number of groups of any 
number pipeline units, and not all the groups need have the same number of pipeline 
units. Furthermore, the communication-bus routers 11Qi~11<k may be omitted as 
discussed above in conjunction with the accelerator 44 of FIG. 6. 

[1 17J The pipeline-unit group 1Wi Includes three pipeline units 7$i - 73$, 

which are connected to an intra-group communication-bus router 110* via branches 
Mi, 84%, and S4 3 , respectively, of a communication bus in a manner similar to that 
discussed above in conjunction with FIG. ?, The oilier groups 120 2 - 12Q& are 
similar, 

[1183 The communication-bus routers 11Qi-1 10 s of the groups 12d - 12% 
are connected to a first-level router 122* via respective branches 124i ~ 124 3 of a 
first-level bus 1 2$i, The router 122 f and bus 126i allow the pipeline units 7$ f ~ 7% 
to communicate with each other, 

£1191 Similarly, the communication- bus routers 1W 4 - 110$ are connected to 

a first-ievel router 122 2 via respective branches 120* ~~ 1 28 3 of a first-level bus 12S* 
The router f22* and bus ?20 2 allow the pipeline units 7B n ~ to communicate 
with each other. 

[120] The first-level routers 122% and 1 22 2 are connected to a second-level 
router 130 via respective branches 132% ~ 1 32 2 of a second-level bus 134. The 
router 130 and bus 134 allow the pipeline units 7Bi ~ 7$» to communicate with each 
other and with other peers/devices as discussed below, 

1121] The pipeline bus §0 and a secondary pipeline bus 136 are coupled to 

the second-level router 1 30 via the respective Industry-standard bus interfaces Mi 
and Mz. The secondary pipeline bus 136 may be connected to peers, such as the 
host processor 42 (FIG. 3), or peripherals, such as a hard-disk drive (not shown), 
that are not coupled to the pipeline bus 50, Furthermore, either or both of the 



28 



WO HHM/M2S*1 



vcttmmmm$$$ 



busses 50 and 1 36 may be coupled to peers or peripherals via a network or the 
Internet (nether shown) such that the accelerator 44 can be remotely located from 
other peers, such as the host processor 42 (FJ0> 3), 

[122] A bus 138 directly connects one or more SYNC signals to all of the 
5 pipeline units 7Bi ™ 78« 5 and to other peers, such as the host processor 42 (FIG. 3), 
or devices (not shown). 

|1233 Still referring to FIG, 8, In one example of operation, each group f 20* - 

1W$ of pipeline units 7B processes data from a respective sensor of a sonar array 
(not shown) that is coupled to the secondary pipeline bus 130. Because the pipeline 

1 0 units 7Bi - 70$ of the group 120 1 are Interconnected by a single router 11&t, these 
pipeline units can communicate with each other more quickly than they can with the 
pipeline units 704 - 78i« of the other groups 120z ~ 120$, This higher communication 
speed is also present in each of the other groups f 2% - 12% Consequently, a 
designer can increase the processing speed of the accelerator 44 by grouping 

1 5 together pipeline units that frequently transfer data or otherwise communicate among 
themselves. 

|124| in general, the pipeline units 78i ~ 70n communicate with each other 
and with peers, such as the host processor 42 (FIG. 3), and devices coupled to the 
buses 50 and 1 36 in a manner similar to that discussed above in conjunction with 

20 FIG. 7. For example, a sensor (not shown) coupled to the bus 130 communicates 
with the pipeline unit 70$ via the industry-standard bus interface 91 1f the 
second-level router 130, the first level router 122% and the intra-group router f 1 0p 
Similarly, the pipeline unit 78i communicates with the pipeline unit 70? via the routers 
110% 122i, and 1 f% and communicates with the pipeline unit 70i$vfa the routers 

25 H0i, 122i, 100, 122 2 , and 110+ 

[12§3 The preceding discussion is presented to enable a person skilled in the 
art to make and use the invention. Various modifications to the embodiments will be 
readily apparent to those skilled in the art, and the generic principles herein may be 
applied to other embodiments and applications without departing from the spirit and 
30 scope of the present invention. Thus, the present invention is not intended to be 

limited to the embodiments shown, but is to be accorded the widest scope consistent 
with the principles and features disclosed herein, 
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WHAT IS CLAIMED IS: 

1 . A pipeline accelerator, comprising: 
a communication bus; and 

a plurality of pipeline units each coupled to the communication bus and each 
5 comprising a respective hardwired-pipeline circuit. 

2, The pipeline accelerator of claim 1 wherein each of the pipeline units 
comprises: 

a respective memory coupled to the hardwired-pipeline circuit; and 
wherein the hardwired-pipeline circuit is operable to, 
1 0 receive data from the communication bus, 

load the data into the memory, 

retrieve the data from the memory, 

process the retrieved data, and 

drive the processed data onto the communication bus. 

1 5 3. The pipeline accelerator of claim 1 wherein each of the pipeline units 

comprises; 

a respective memory coupled to the hardwired-pipeline circuit; and 

wherein the hardwired-pipeline circuit is operable to, 

receive data from the communication bus, 
20 process the data, 

load the processed data into the memory, 
retrieve the processed data from the memory, and 
ioad the retrieved data onto the communication bus. 

4, The pipeline accelerator of claim 1 wherein each of the 

25 hardwired-pipeline circuits is disposed on a respective field-programmable gate 
array. 

5. The pipeline accelerator of claim 1 , further comprising: 
a pipeline bus; and 

a pipeline-bus Interface coupled to the communication bus and to the pipeline 

30 bus. 

30 
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6, The pipeline accelerator of claim 1 , further comprising: 

wherein ft© communication hus comprises a plurality of branches, a 
respective branch coupled to each pipeline unit; and 
a router coupled to each of the branches. 

5 7. The pipeline accelerator of claim 1 , further comprising: 

wherein the communication bus comprises a plurality of branches, a 
respective branch coupled to each pipeline unit; 
a router coupled to each of the branches; 
a pipeline bus; and 

1 0 a pipeline-bus Interface coupled to the router and to the pipeline bus, 

8. The pipeline accelerator of claim 1 , further comprising: 

wherein the communication bus comprises a plurality of branches, a 
respective branch coupled to each pipeline unit; 
a router coupled to each of the branches; 
15 a pipeline bus; 

a pipeline-bus interface coupled to the router and to the pipeline bus; and 
a secondary bus coupled to the router. 

8, The pipeline accelerator of claim 1 wherein: 

the communication bus is operable to receive data addressed to one of the 
20 pipeline units; and 

the one pipeline circuit is operable to accept the data; and 
the other pipeline circuits are operable to reject the data. 

1 0, The pipeline accelerator of claim 1 , further comprising: 

wherein the communication bus comprises a plurality of branches, a 
2§ respective branch coupled to each pipeline unit; 

a router coupled to each of the branches and operable to, 

receive data addressed to one of the pipeline units, and 
provide the data to the one pipeline unit via the respective branch of 
the communication bus, 

30 11. A computing machine, comprising: 

31 
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a processor; 

a pipeline bus coupled to the processor; and 
a pipeline accelerator comprising, 
a communication bus, 
5 a pipeline-bus interface coupled between the pipeline bus and the 

communication bus, and 

a plurality of pipeline units each coupled to the communication bus and 
each comprising a respective hardwired-pipeline circuit. 

12, The computing machine of clam 1 1 wherein: 

1 0 the processor is operable to generate a message that identifies one of the 

pipeline units and to drive the message onto the pipeline bus; 

the pipeline-bus interface is operable to couple the message to the 
communication bus; 

the pipeline units are each operable to analyze the message; 
1 5 the Identified pipeline unit is operable to accept the message; and 

the other pipeline circuits are operable to reject the message. 

1 3, The computing machine of claim 1 1 , further comprising: 

wherein the communication bus comprises a plurality of branches, a 
respective branch coupled to each pipeline unit; 
20 wherein the processor Is operable to generate a message that identifies one 

of the pipeline units and to drive the message onto the pipeline bus; and 

a router coupled to each of the branches and to the pipeline-bus Interface and 
operable to receive the message from the pipeline-bus Interface and to provide the 
message to the Identified pipeline unit. 

25 14. The computing machine of claim 1 1 , further comprising; 

wherein the communication bus comprises a plurality of branches, a 
respective branch coupled to each pipeline unit; 
a secondary bus; and 

a router coupled to each of the branches, to the pipeline-bus interf ace, and to 
30 the secondary bus. 

15. A method, comprising: 

32 
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sending data to first of a plurality of pipeline units via a communication bus, 
each pipeline unit Including a respective hardwired pipeline; and 
processing the data with the first pipeline unit. 

1 8. The method of claim 1 5 wherein sending the data comprises: 

5 sending the data to a router; and 

providing the data to the first pipeline unit with the router via a respective first 
branch of the communication bus. 

1 7. The method of claim 1 5 wherein sending the data comprises sending 
the data to the first pipeline unit with a processor, 

1 0 1 8. The method of claim 1 6 wherein sanding the data comprises sending 

the data to the first pipeline with a second of the plurality of pipeline units. 

1 9. The method of claim 1 5, further comprising driving the processed data 
onto the communication bus with the first pipeline unit 

20. The method of claim 15 wherein processing the data with the first 
1 5 pipeline unit comprises: 

receiving the data from the communication bus with a hardwired-pipeline 

circuit, 

loading the data info a memory with the hardwired-pipeline circuit, 
retrieving the data from the memory with the hardwired-pipeline circuit, and 
20 processing the retrieved data with the hardwired-pipeline circuit 

21 . The method of claim 1 5, further comprising: 

wherein processing the data with the first pipeline unit comprises, 
receiving the data from the communication bus with a 
hardwired-pipeline circuit, 
25 processing the received data with the hardwired-pipeline circuit, and 

loading the processed data into a memory with the hardwired-pipeline 

circuit; and 

retrieving the processed data from the memory and driving the 
processed data onto the communication bus with the hardwired-pipeline circuit. 

30 22, The method of clam 1 5, further comprising: 
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generating a message that includes the data and that identifies the first 
pipeline unit as a recipient of the message; and 

wherein sending the data to the first pipeline unit comprises determining from 
the message that the first pipeline is a recipient of the message. 
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